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Abstract 

We consider the communication capacity of wireline networks for a two-unicast traffic pattern. The network has 
two sources and two destinations with each source communicating a message to its own destination, subject to the 
capacity constraints on the directed edges of the network. We propose a simple outer bound for the problem that 
we call the Generalized Network Sharing (GNS) bound. We show this bound is the tightest edge-cut bound for 
two-unicast networks and is tight in several bottleneck cases, though it is not tight in general. We also show that 
the problem of computing the GNS bound is NP-complete. Finally, we show that despite its seeming simplicity, 
the two-unicast problem is as hard as the most general network coding problem. As a consequence, linear coding 
is insufficient to achieve capacity for general two-unicast networks, and non-Shannon inequalities are necessary for 
characterizing capacity of general two-unicast networks. 


I. Introduction 

The holy grail of network information theory is the characterization of the information capacity of a general 
network. While there has been some success towards this goal, a complete capacity characterization has been open 
for even simple networks such as the broadcast channel, the relay channel, and the interference channel. 

The seminal work of Ahlswede et al. ||T] characterized the information capacity of a family of networks assuming 
a simple network model ((i.e. assuming a directed wireline network where links between nodes are unidirectional, 
orthogonal and noise-free), and a simple traffic pattern (i.e. multicast, where the same information is to be transmitted 
from one source node to several destination nodes). Under this network model, the complex aspects of real-world 
communication channels, such as broadcast, superposition, interference, and noise are absent. Similarly, the traffic 
pattern is simple and ensures that there is no interference from multiple messages. Q showed that for multicast 
in directed wireline networks, a simple outer bound on capacity, namely the cutset bound Q was achievable, 
completing the capacity characterization. Later, Q and Q showed that a simple class of coding strategies - linear 
network coding over a finite field - can achieve the multicast capacity of a wireline network. In spite of the simplicity 
of this network model, understanding the capacity region of multicast in directed wireline networks has proved very 
useful in offering insight into capacity and coding strategies for other network models, such as Gaussian networks 
0. Subsequently, the directed wireline network capacity characterization problem was solved for the traffic patterns 
of two-level multicast Q (i.e. a source node produces k messages, each message to be delivered at exactly one 
destination (first-level), and in addition, a collection of nodes (second-level) requiring all the messages) and two- 
receiver multicast with private and common data 0 . 0 - In both these cases, the cutset bound was shown to be 
tight. 

However, it was soon discovered that the capacity characterization of a general traffic pattern for the simplified 
network model of directed wireline networks was still a problem of considerable difficulty. Q showed that linear 
codes were not sufficient to achieve capacity for the general traffic pattern. Q showed that the so-called LP bound 
pO) , which is a computable outer bound on the capacity, tighter than the cutset bound, derived from all possible 
so-called Shannon-type inequalities, was not tight in general. GD showed that if we can compute the network 
capacity region for the general traffic pattern, then we can characterize all the so-called non-Shannon information 
inequalities. However, the networks presented as counterexamples in all the above works either have more than two 
sources or more than two destinations, often much more. It is a natural question to ask whether the difficulty of 

Parts of this paper were presented at the International Symposium on Network Coding 2011, Beijing, China, the International Symposium on 
Information Theory 2013, Istanbul, Turkey, and the International Symposium on Information Theory 2014, Honolulu, Hawaii. 
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the problem stems from this. This is hardly an unusual sentiment since many different but related problems enjoy 
a simplicity with 2 users that is not shared by the corresponding problems with 3 or more users. For instance: 


• For two-unicast undirected networks, the cutset bound is tight but this is not the case for three-unicast undirected 
networks in- 

• The capacity of two-user interference channels is known to within one bit GD but no such result is known 
for three-user interference channels. 

• The capacity region up to unit rates for layered linear deterministic networks has been characterized for two- 
unicast networks 03 but not for three-unicast networks. 

• The degrees of freedom for layered wireless networks is known for two-unicast networks 03 but not for 
three-unicast networks. 

• There are no known analogs with three-receivers for the aforementioned two-receiver multicast problem with 
private and common data ©, 0 . 


The central candidate for the simplest unsolved problem in capacity of wireline networks is the two-unicast 
traffic pattern, i.e. the problem of communication between two sources and two destinations, each source with an 
independent message for its own destination. The only complete capacity result in the literature dealing with the 
two-unicast network capacity is 03 which characterizes the necessary and sufficient condition for achieving ( 1 , 1 ) 
in a two-unicast network with all links having integer capacities. This result unfortunately relies heavily on the 
assumption of integer link capacities, and hence cannot give us necessary and sufficient conditions for achieving 
other points such as (2,2) or (3,3) by scaling of link capacities. This success with the (1,1) rate pair in two- 
unicast networks stands in strong contrast with the intractability of the general fc-unicast problem 0, 0, OD- 
Although the two-unicast capacity characterization for general rates (i?i,i? 2 ) remains open, it is often believed 
that the two-unicast problem enjoys a similar simplicity as other two-user information theoretic problems. There 
are many existing results that aim to characterize the general achievable rate region for the two-unicast problem 
(not limited to the (1,1) case in |16|) and/or the fc-unicast problem with small k. For example, p7| , p 8 ) , and 
| fT 3 study capacity of two-unicast, three-unicast, and fc-unicast networks respectively, from a source-destination 
cut-based analysis. The authors of |[20) present an edge-reduction lemma using which they compute an achievable 


region for two-unicast networks. In a subsequent work pT[ they show that the Generalized Network Sharing bound 
that we will study in this paper gives necessary and sufficient conditions for achievability of the (iV, 1) rate pair in 
a special class of two-unicast networks (networks with Z-connectivity and satisfying certain richness conditions). 
Unfortunately, none of the above results is able to fully characterize the capacity region for general two-unicast 
networks even for the second simplest instance of the rate pair ( 1 , 2 ), let alone the capacity region for three-unicast 
or fc-unicast networks (for small k). Such a relatively frustrating lack of progress prompts us to re-examine the 
problem at hand and investigate whether the lack of new hndings is due to the inherent hardness of the two-unicast 
problem. 

In this paper, we have contributions along two main themes. Along the hrst theme, we present and investigate a 
new outer bound for the two-unicast problem that is stronger than the cutset bound. This new bound is a simple 
improvement over the Network Sharing outer bound of | |22) , and we call it the Generalized Network Sharing (GNS) 
outer bound. We observe that the GNS bound is the tightest edge-cut bound for the two-unicast problem, and is tight 
in various “bottleneck” cases. However, we hnd that the GNS bound is NP-complete to compute and is also not 
tight for the two-unicast problem. Along the second theme, we show that the lack of success so far with a complete 
characterization of capacity for the two-unicast problem is due to its inherent hardness. We show that the two-unicast 
problem with a general rate pair (i?i, R 2 ) captures all the complexity of the multiple unicast problem, i.e. solving 
the two-unicast problem for general rate pairs is as hard as solving the A:-unicast problem for any k > 3. Thus, the 
two-unicast problem is the “hardest network coding problem”. We show that given any multiple-unicast rate tuple, 
there is a rate tuple with suitable higher rates but fewer sources that is more difficult to ascertain achievability of. 
In particular, we show that solving the well-studied but notoriously hard fc-unicast problem with unit-rates (eg. 0, 
0) is no harder than solving the two-unicast problem with rates {k — l,k). Furthermore, by coupling our results 
with those of 0 , 0 , we show the existence of a two-unicast network for which linear codes are insufficient to 
achieve capacity, and a two-unicast network for which non-Shannon inequalities can provide tighter outer bounds 
on capacity than Shannon-type inequalities alone. 

We mention here that since it hrst appeared in | |2^ , the GNS bound has found three distinct interpretations: an 
algebraic interpretation pO) , a network concatenation interpretation p4) , and a maximum acyclic subgraph bound 
through a connection with index coding | |25) . The bound has also found a number of applications, eg. 03, ( 23 , 

03. 

The rest of the paper is organized as follows. In Sec. [I^ we set up preliminaries and notation. We propose an 
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improved outer bound for the two-unicast problem that we call the Generalized Network Sharing (GNS) bound, 
and study its properties in Sec. [Ill] We show that the two-unicast problem with general rate pairs is as hard as the 


fc-unicast problem with A: > 3, in Sec. IV 


II. Preliminaries 

A fc-unicast network Af consists of a directed acyclic graph Q = {V,S) (V being the vertex set and S being 
the edge set), along with an assignment of edge-capacities C = (C'e)eGf(e) with S K>o U { 00 } Ve G ^{Q)- 
It has k distinguished vertices si, S 2 , ■ ■ ■, Sk called sources (not necessarily distinct) and k distinguished vertices 
G, ^ 2 , • ■ •) ffc called destinations (not necessarily distinct from each other or from the sources), where source Si has 
independent information to be communicated to destination ti,i = 1,2,... ,k. 

For edge e = {v,v') G £((/), dehne tail(e) := v and head(e) := v', the edge being directed from the tail to the 
head. For v G V((/), let ln(u) and Out(u) denote the edges entering into and leaving v respectively. 

For S C £"((/), dehne C(S} := For sets A,BC V((/), we say S C £(Q) is an A — B cut if there 

is no directed path from any vertex in A to any vertex in B in the graph Q \ S. Dehne the mincut from A io B 
by c(A; B) := min {C(S') : 5* is an A — i? cut} , where by convention, c(A; B) = 0, if there are no directed paths 
from A to i? or if either A or i? is empty, and also c(A; i?) = 00 if A H i? ^ 0. 

Definition 1. Given a fc-unicast network N = iG,C) for source-destination pairs {(s^;we say that the 
non-negative rate tuple (i?i, R 2 ,..., Rk) is achievable, if for any e > 0, there exist positive integers N and T 
(called block length and number of epochs respectively), a finite alphabet A with |A| > 2 and using notation 
Hy := (with an empty product being the singleton set), 

• encoding functions for 1 < f < T, e = {u, v) G S, 

fe,t ■■ Hy X n,,eln(.) ^ 

• decoding functions at destinations ti for i Gl, 

/*.: X n,,(AL^^e-J)^^Ar™i 

with the property that under the uniform probability distribution on > 

Pr(p(mi,m 2 ,... ,mfc) ^ {mi,m 2 , ■ ■ ■ ,mk)) < e, (1) 

where g : i-a is the global decoding function induced inductively by {fe,t '■ e G 

£{G), 1 < f < Tj and {/*, A = 1, 2,..., k}. 

The Shannon capacity (also simply called capacity) of a fc-unicast network Af, denoted C{N) = C{G,C), is 
defined as the closure of the set of achievable rate tuples. The closure of the set of achievable rate tuples over 
choice of A as any finite field and all functions being linear operations on vector spaces over the finite field, is 
called the vector linear coding Shannon capacity or simply linear coding capacity. If we further have N = 1, then 
the convex closure of achievable rate tuples is called the scalar linear coding capacity. 

The zero-error capacity, zero-error linear coding capacity are similarly defined as the closure of the set of 
achievable rate tuples with zero error using general and vector linear codes respectively. Finally, the zero-error 
exactly achievable region and zero-error exactly achievable linear coding region are similarly defined as the set of 
achievable rate tuples with zero error (no closure taken), using general and vector linear codes respectively. This 
notion of exact achievability when studied with unit rates, is also called solvability in the literature [ |28] . 

Table U summarizes these definitions. 

III. Generalized Network Sharing Outer Bound 

We introduce the Generalized Network Sharing (GNS) bound as a simple outer bound on the Shannon capacity 
of a two-unicast network that is tighter than the cutset bound 0. 

We say a set of edges S C £{G) form a Generalized Network Sharing cut (GNS-cut) if 

• G \ S has no paths from si to G, S 2 to G and S 2 to ti OR 

• G \ S has no paths from si to G, S 2 to G and Si to t 2 . 

We adopt the natural convention that if u and v are the same node, then, no cut separates u from v. Thus, if 
S 2 =ti, then a set of edges S forms a GNS-cut only if it removes all paths from si to G, S 2 to ^2 and si to ^ 2 - 

Theorem 1. (GNS outer bound) For a two-unicast network Af = (G,C) ond a GNS cut S C £(G), we have 
-Ri + -R 2 < C(R) V (i?i, i?2) G CiJV). 
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General codes 


Vector Linear codes 


Zero-error Exact 
Achievability 


Zero-error Capacity 


Shannon Capacity 


Set of linearly achievable rate tuples 
with zero error 

C 

(A fr'SSi 0) 

Set of achievable rate tuples with 
zero error 

n 

(=, 7^ unknown) 


in 

if from (23) 

Closure of set of linearly achievable rate 
tuples with zero error 

c 

(A (8)) 

Closure of set of achievable rate 
tuples with zero error 

(= from simple argument; see Remark]^ at 
end of Appendix 


n 

(=,f unknown |30|) 

Closure of set of linearly achievable rate 
tuples with vanishing eiTor 

c 

fr'3Si 0) 

Closure of set of achievable rate 
tuples with vanishing error 


TABLE I 

Different notions of capacity 


Remark 1. Our name for the Generalized Network Sharing bound is derived from an earlier bound in the literature 
called the Network Sharing bound |22| which may be described as follows: Fix (z,j) = (1,2) or (2,1). For a 
two-unicast network M = {Q, C), \f T Q 8{Q) is an {si, S 2 } — {fi, 12 } cut and if S' C T is such that for each edge 
e G T\ S, we have that tail(e) is reachable from Si but not from Sj in Q(*) and head(e) can reach tj but not ti in 
Q, then we have i?i -f i ?2 < C'(S) V(i?i,i? 2 ) G C(M). If the (*) were replaced by ^ \ S, then we would get the 
GNS bound. Thus, the improvement in the bound is very subtle but important. 

The proof of the GNS bound relies on the same idea that was used to prove the Network Sharing bound. The 
GNS bound subsumes the Network Sharing bound and it can be strictly tighter, as shown by the grail network in 
Fig. [3 In Theorem we will show that the GNS bound is fundamental to the two-unicast problem: in the class 
of edge-cut bounds, it is the tightest and cannot be further improved upon. 


Proof. Suppose for a set of edges S C 8{Q)^ Q\S has no paths from si,S 2 to ti and no paths from S 2 to 12- 
Fixing 0 < e < 1, consider a scheme of block length achieving the rate pair (i?i,i? 2 ) over alphabet A with 
error probability at most e. Let Wi, W 2 be independent and distributed uniformly over the sets and 

respectively. For each edge e, define Xg as the concatenated evaluation of the functions specified by the scheme 
for edge e. For S C 8(Q), let Xs := {Xg)g^s- To simplify calculations, we will assume all logarithms are to base 

|A|. 

As Q \ S has no paths from si or S 2 to G, it follows that the message Wi can be recovered successfully from 
Xs with probability at least 1 — e. Then, by Fano’s inequality. 


H{Wi\Xs)<h{e) + e\NRi^. (2) 

Similarly, since Q \ S has no paths from S 2 to t 2 , it follows that the message W 2 can be recovered successfully 
from Xs and Wi with probability at least 1 — e. Fano’s inequality gives 

ff(W2lWi,Xs)<h(e) + e[NR2f (3) 
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(a) Grail network with general 
edge capacities 


(b) Grail with variable edge ca¬ 
pacities. 62,67 have unit capacity 
and all other edges have capacity 
2 units. 


(c) Network Sharing outer bound and GNS outer bound 
for the network in (b) 


Fig. 1. The GNS outer bound can be strictly better than the Network Sharing outer bound (22| . {62,67} is a GNS-cut. 


This gives 

N{Ri+R2) < H{Wi,W2) 

= I{Wi,W2; Xs) + HiWi,W2\Xs) 

= I{Wi,W2;Xs) + H{Wi\Xs) + H{W2 \Wi,Xs) 

< H[Xg) + 2h{e) + e{N[Ri + R 2 ) + 2) 

< NC{S) + 2(e + h(e)) + Ne(Ri + R 2 ) 

Ri + i?2 < C!{S) + ^(^1 + ^ 2 ) 

< C{S) + 2(e + h{€)) + e{Ri + R 2 ). 


(4) 

(5) 

( 6 ) 

(7) 

(8) 

(9) 

( 10 ) 


Since e can be made arbitrarily small by a suitable coding scheme with a suitable block length, from ( [T0| ), we must 
have i?i + i ?2 < C{S). As this inequality holds for every vanishing error achievable rate pair (i?i,i? 2 ), it also 
holds for every point in the closure of the set of vanishing error achievable rate pairs. □ 


For a given two-unicast network JV = {G,Q, let the GNS sum-rate bound Cgns(si, S2; fi, f2) be defined as 
Cgns(si; S 2 ; ill ^ 2 ) ■= min{C'(S') : S C £{Q) is a GNS-cut}. The GNS outer bound is defined as the region 
i? 2 ) : Ri < c(si; fi), i ?2 < c(s 2 ; ^ 2 ), 7?i + 7^2 < Cgns(si, S 2 ; ii, i 2 )}- Note that the GNS sum-rate bound is a 
number while the GNS outer bound is a region. 

Before moving to properties of the GNS bound, we briefly remark that the GNS bound may be extended to 
multiple unicast networks as stated in Theorem below. The proof is very similar to that of Theorem [T] and is 
omitted. 


Theorem 2. Consider a k-unicast network Af — (G,C}. For non-empty I C {1, 2,..., fcj and S C £{G), suppose 
there exists a bijection tt : 1 1 -^ {1, 2,..., |/|} such that W i,j G I, G\S has no paths from source Si to destination 
tj whenever 7r(i) > 7r(j). Then, 

Y,R^<C{S) V(i?i,i?2,...,-R„) eC(V). 

iei 


A. GNS bound is the tightest edge-cut outer bound for two-unicast 

For an uncapacitated two-unicast network Q (i.e. a two-unicast graph), an inequality of the form aii?i -|-a 2 i ?2 < 
C{S), with ai, a2 G {Oj 1}) >5' C £{G) is called an edge-cut bound if the inequality holds for all (i?i, R 2 ) & C{G, C), 
for each choice of edge capacities C. The cutset outer bound Q, the Network Sharing bound and the GNS 
bound are all collections of edge-cut bounds. 
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Theorem 3. Let Q be an uncapacitated two-unicast network, and let S C E{Q) be such that i?i + i ?2 < C{S) is 
an edge-cut bound, i.e. i?i + i ?2 < C(S) holds for all {Ri,R 2 ) G C{G,C) for all choices of C. Then, exactly one 
of the following is true: 

• S is a GNS-cut 

• S is not a GNS-cut but c{si]ti) + c(s 2 ;t 2 ) < C{S) for all choices of C. 

Remark 2. Since the cutset bound is tight for single unicast, the cutset bounds provide all possible edge-cut bounds 
on the individual rates. Theorem says that the GNS cuts together provide all possible edge-cut bounds on the 
sum rate that are not already implied by the individual rate cutset bounds. 

Proof Suppose i?i -f i ?2 < C{S) holds for all {Ri^Rf) S C{Q, C) for all choices of C. Then, clearly Q\S has no 
paths from si to ti and no paths from S 2 to t 2 - Suppose S is not a GNS-cut so that Q\S has no paths from si to ti or 
from S 2 to t 2 but it has paths from si to t 2 and S 2 to ti. Define Ci{S) := min{C'(r) : T C S, T is an Si — ti cut} 
for i = 1,2. Fix any choice of non-negative reals {cg : e G S'}. Consider the following choice of link capacities: 
Cg = Cg Ve G S and Cg = oo Ve ^ S. For this choice of link capacities, the individual rate mincuts are given by 
c{si]ti) = Ci{S),i = 1,2. We will use the following lemma proved in Appendix [A| 

Lemma 1. (Two-Multicast Lemma) For a two-multicast network Af = {G,C) with sources si and S 2 multicasting 
independent messages at rates Ri and i ?2 respectively to be recovered at both the destinations ti and t 2 , the 
capacity region is given by 

Ri < min{c(si;fi),c(si;f 2 )}, 
i?2 < min{c(s2;ii),c(s2;f2)}, 

Ri+ R 2 < min{c(si, S 2 ; fi), c(si, S 2 ; ^ 2 )}- 


By Lemma (i?i,i?2) is achievable for two-multicast from Si,S 2 to ^ 1,^2 if and only if Ri < C'i(S) and 
f ?2 < €2(3), since c(si, S 2 ; G) > c{s2: G) = 00, c(si, S 2 ; G) > c(si; G) = 00. Thus, {Ci{S), C2{S j) is achievable 
for two-multicast and hence, also for two-unicast. Since Ri -\- R2 < C{S) holds for all (i?i,i? 2 ) G C{G,C), we 
must have C'i(S) -I- 02(8) < C{S) V{Cg : e G S}. This is a purely graph theoretic property about the structure of 
the set of edges S relative to the uncapacitated network G- Now, for an arbitrary assignment of link capacities C, 
we have by definition, c(si;ti) < C'i(S) and c(s 2 ;G) < C'2(S). Thus, we have c(si;G) +c(s 2 ;G) < C'(S). □ 

Example 1. Consider the butterfly network in Fig. One can show that i?i -f i ?2 < Ce^ -f Gg^ is an edge-cut 
bound, that is it holds for each (i?i,i?2) G C{G,Q, for each choice of edge-capacities C. However, {61,62} is not 
a GNS-cut. So, in accordance with Theorem]^ this edge-cut bound must be implied by the individual rate cutset 
bounds and indeed it follows from the cutset bounds i?i < Ggj,i ?2 < Ggj. 



Fig. 2. Butterfly Network 


Example 2. Below are the three bounds for the grail network in Fig. [TJa). Since each edge in the grail network has 
a path from it to both destinations or has a path from both sources to it, the Network Sharing bound and Cutset 
bound are identical. The one inequality that is different in the two collections has been highlighted. As Theorem]^ 
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will show, the GNS outer bound collection on the right hand side below in fact, contains all possible edge-cut 
bounds for the grail network. 


Cutset Bound and Network Sharing Bound for the 
Grail Network in Fig. [^a) 


Generalized Network Sharing (GNS) Bound for the 
Grail Network in Fig. [^a) 
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0 - 1331 . 

However 

it has the advantage 


of being simpler and more explicit. Furthermore, from Theorem the GNS outer bound is the tightest possible 
collection of edge-cut bounds for two-unicast networks and hence, is equivalent to the bounds in pT)-p^ for 
two-unicast networks. 


B. Tightness under GNS-cut bottleneck 

The next theorem shows that any minimal GNS-cut, i.e. a GNS-cut with no proper subset that is also a GNS-cut, 
provides an outer bound that is not obviously loose. 

Theorem 4. For a given two-unicast graph Q, let S Q £{Q) be a minimal GNS-cut. Choose an arbitrary collection of 
non-negative reals {ce '■ e G S'}. Consider the following link-capacity-vector C : Ce = Ce^e G S, Ce = oo Ve ^ S. 
Then, for the two-unicast network {G,C), the GNS outer bound is identical to the capacity region C(Q,C), i.e. the 
GNS outer bound is tight. 

Remark 4. Theoremdoes not say that a sum rate of Cgn 5 (si, S 2 ;^i, ^ 2 ) = C'(S) is achievable, only that all rate 
pairs in : Ri < c(si;fi),i ?2 < c{s 2 \t 2 ), Ri + i ?2 < Cgns(si, S 2 ; G, < 2 )} are achievable. A sum rate of 

C'(S) is achievable only when C(S) < c(si;fi) -f c{s 2 ',t 2 ) for the choice of capacities. 

The proof is relegated to Appendix Theorem also holds when Ce for e ^ S are all hnite and sufficiently 
large, i.e. when Ce > C{S) Ve ^ S. This can be concluded from the proof by using the fact that the coding scheme 
is linear over the binary held F 2 . 

C. The GNS outer bound is not tight 

We discussed in Section |III-A| that for two-unicast networks, the GNS outer bound is equivalent to the bounds 
in f3T)-0. However, the GNS outer bound is also a special case of the so-called LP bound in flO) , which is the 
tighest outer bound obtainable using Shannon information inequalities alone. In this subsection, we will show that 
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the LP bound is tighter than the GNS outer bound for general two-unicast networks. We provide an example of a 
two-unicast network, the crossfire network in Fig. |^a) showing that; 

• the GNS outer bound is not tight, so edge-cut bounds do not suffice to characterize the capacity region; 

• the trade-off between rates on the boundary of the capacity region need not be 1 : 1 ; 

• the capacity region may have a non-integral corner point even if all links have integer capacity and thus; 

• scalar linear coding is not sufficient to achieve capacity. 

Achievability of the capacity region in Fig. |^c) follows from a two time step vector linear coding scheme over 
F 2 that achieves (1,1.5) shown in Fig. [^b). 




in (a) 


Fig. 3. GNS outer bound is not tight 

Suppose (i?i, i? 2 ) is a vanishing error achievable rate pair. Fixing 0 < e < i, consider a scheme of block length 
N, achieving the rate pair (i?i, R 2 ) over alphabet A with error probability at most e. Let Wi, W 2 be independent 
and distributed uniformly over the sets and respectively. For each edge e = ei, 62 , 63 , 64 , dehne Xg 

as the concatenated evaluation of the functions specihed by the scheme for edge e. We will assume all logarithms 
are to base |.A|. 
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By Fano’s inequality, 

H{Wi\Xe,,Xe,,X,,) < hie) + e\NRi], ( 11 ) 

H{W2\Wi,Xe,,Xe„X,J < h{e) + e\NR2^. ( 12 ) 

Now, 

NRi < H{Wi) (13) 

= I{Xe„X,„Xe,;Wi) + H{Wi\X,,,X,,,Xe,) (14) 

= IiX,„Xe,-,Wi)+I{X,,;Wi\X,„X^,)+h{e) + e\NRi] (from ([TT)) (15) 

I{X ,^, Xe,; VFi) = I{Xe,,X,^;Wi,W2)- /(X ^,, X,,; H^21) (16) 

= H{Xe,,Xe,) - H{W2 \Wi) + H{W2\Wi,Xe„Xe,) (17) 

= H{X,„X,,)-H{W 2 ) + h{e) + e\NR 2 ^ (from @) (18) 

<NCe,+NCe^-NR2 + h{e) + e\NR2^ (19) 

J(Xe,; WilX ,^, XeJ = J(Xe,; Wi, Xe,, J - I(X ,^; Xe, , Xe,) (20) 

<H{X,,)-I{X,,-W2) (21) 

= i7(XeJ - J(Xe3, Xe,; 1 X 2 ) + /(Xe3; M^2[X,J (22) 

<i7(XeJ- 77 ( 1 X 2 ) +77(Xe3|XeJ (23) 

= 77(X,3,X,J- 77 ( 1 X 2 ) (24) 

< XCe 3 + NCe, - NR 2 (25) 

From ([^, ([g, we can deduce 

7?i + 27?2 < Cei + + Cej + Ce^ + 2(e + 7(e)) + e(7?i + R 2 ) (26) 


Since e can be made arbitrarily small by a suitable coding scheme with a suitable block length, we must have 
7?i + 7?2 < Cej + Ce 2 + Ceg + Ce^ = 4. As this inequality holds for every vanishing error achievable rate pair 
(7 ?i, 7?2), it also holds for every point in the closure of the set of vanishing error achievable rate pairs. Thus, the 
network has a capacity region as shown in Fig. |^c). 

Finally, simple routing strategies achieve (1,1) and (0,2), whereas due to the constraint 7?i + 27?2 < 4, no 
coding strategy can achieve (1,2). As routing is a special case of scalar linear coding, the scalar linear coding 
region is the convex closure of the integral rate pairs (1,1), (0, 2), (0,1), (0, 0) and hence, is as shown in Fig. |^c). 


D. NP-completeness of minimum GNS-cut 

We have shown in Section III-A| that the GNS bound provides the tightest collection of edge-cut bounds for 
two-unicast networks. This brings up a natural question of computational complexity of the GNS bound. Since the 
number of GNS-cuts is in general, exponential in the size of the network, listing all of them is intractable. For a 
single-unicast problem, we know that there exists an algorithm | |34| , p5| that computes the mincut and reveals a 
minimizing cut efficiently in spite of there being exponentially many edge-cuts. Given a two-unicast network, can 
we find an algorithm that efficiently finds, among all GNS-cuts S, one that has the smallest value of 
Theorem 1^ shows unfortunately that we cannot (unless P=NP). Define the following decision problem: 

MIN-GNS-CUT 


Instance: A two-unicast (capacitated) network Af = {G,C). 

Question: Is there a GNS-cut S so that C{S) < K1 
Theorem 5. MIN-GNS-CUT is NP-complete. 

Proof. It is clear that MIN-GNS-CUT is in NP. We give a polynomial transformation from the multiterminal cut 
problem for three terminals which is known to be NP-complete p^ . In the multi terminal cut problem, we are given 
a number K and an unweighted undirected graph 77 with three special vertices or ‘terminals’ x, y, z. We are asked 
whether there is a subset of edges F of the graph 77 with |F| < X such that 77 \ F has no paths between any two 
of X, y, z. Given (77, X), we construct a corresponding instance of MIN-GNS-CUT as follows. Let the number of 
edges of 77 be X with K < N. 
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The two-unicast capacitated network Q is obtained by replacing each undirected edge (m, v) of H with a gadget 
as shown in Fig. The gadget introduces two new vertices w,w' and constitutes five edges, the one central edge 
having unit capacity and f owe flank edges each having capacity iV + 1 units. Finally, si is identified with terminal 
cc, t 2 with terminal y and both S 2 and ti with terminal z. 


©- 0 

(a) (b) 

Fig. 4. (a) shows an undirected edge and (b) the corresponding gadget 

We will show that Q has a GNS-cut S with C'e < Ff if and only if H has a set of edges F forming a 

multiterminal cut with |F| < K. 

Suppose that in the undirected graph H, there is a multiterminal cut F with at most K edges. Then, picking the 
central edge of the gadgets corresponding to the edges in F gives a GNS-cut S in Q, such that “ 1*^1 — 

Conversely, suppose there is a GNS-cut S' in ^ which satisfies X^egS identified, it 

must be that Q\S has no paths from si to G, from S 2 to t 2 and from si to G- Moreover, as K < N, the GNS-cut 

S cannot contain any flank edge, and hence must consist exclusively of central edges of gadgets. Choosing the 
undirected edges of H corresponding to the gadgets whose central edges lie in S gives an edge set F of H that 
has at most K edges and is a multiterminal cut in "H. □ 



E. Recent Results 

The Generalized Network Sharing bound has found some interpretations and extensions in recent years. In this 
subsection, we summarize some of these new results; 

• The GNS-cut and GNS bound can be defined analogously for a fc-unicast network (see Theorem]^ 

• The GNS bound has been given three different interpretations: 

- Algebraic interpretation pO) ; 

- Graph-theoretic interpretation via index coding p5) ; 

- Network concatenation interpretation p4| . 

• The GNS bound has been observed to be special cases of general bounds for a larger family of networks: 

- The Generalized Cutset bound for deterministic networks Pi; 

- The Chop-and-Roll Directed Cutset bound for general noisy networks p7|. 

• The GNS-cut for a fc-unicast network can be approximated to within an 0(log^ k) factor in polynomial time 
1^. T his has been improved to an approximation algorithm that approximates it to within an 0(logA:) factor 
in 138). 


IV. Two-unicast is as hard as A:-unicast 

A number of recent results have provided evidence that the A:-unicast problem for general fc is a hard problem Q, 
pj. We show that in fact, the simplest case k = 2 encapsulates all the hardness of the general A:-unicast problem. 
Speicifically, we show that the problem of determining whether or not the rate point (1,1,...,!) is zero-error 
exactly achievable in a general A;-unicast network can be solved if the problem of determining whether or not the 
rate point {k — l,k) is zero-error exactly achievable in a general two-unicast network is solved. For important 
technical reasons, we will restrict to zero-error exact achievability. We will discuss other notions of capacity later in 
this section (see Table [n| below and also Remark]^ at the end of Appendix [^l. For simplicity, we will also restrict 
to networks with integer link capacities and zero-error exactly achievable integer rates. These are without loss of 
generality. The notion of ‘hardness’ in this section is distinct from the NP-hardness of computation of GNS-cut 
that we described in Sec. III-D We say two-unicast is as hard as A:-unicast in the sense that even for two-unicast 
networks, linear codes are insufficient for achieving capacity Q and Shannon-type information inequalities are 
insufficient to characterize capacity Q. 
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Definition 2. For integer rate tuples R = {Ri, R2, ■ ■ ■, = (^1) -^2 > • • •) )) we say R ^ R' if any algorithm 

or computational procedure that can determine whether R' is zero-error achievable (or zero-error achievable by vector 
linear coding) in any given network can be used to determine whether R is zero-error achievable (respectively zero- 
error achievable by vector linear coding) in any given network. 




Fig. 5. A pictorial proof for the Fusion and Monotonicity properties of . The label in red denotes edge capacity. In (a), {Ri +-R 2 > ^ 3 ? • • • ? Rk) 
is zero-en'or achievable in the network block -Bj iff (i?i, R 2 , • • •, Rk) is zero-error achievable in the extended network. In (b), {Ri , R 2 ,. • •, Rk ) 
is achievable in the network block Bm iff {Ri + ri , R 2 + r 2 ,.. •, Rk + ^’fc) is achievable in the extended network. 


The following properties may be observed very easily (see Fig. [^; 

. If TT is any permutation on {1, 2,..., fc}, then {Ri, R 2 ,..., Rk) ^ ■ ■ ■, f?,r(fc))- 

. Fusion: (i?i -f R2,R3, ■ ■ •, Rk) di iRi,R 2 ,R 3 , ■ • ■, Rk)- 

• Monotonicity: If Ri, Vi > 0 for each i, then (i?i, ,..., Rk) ^ (Ri + ri,..., Rk + rk). 



Fig. 6. Key idea of the reduction in the proof of Theorem]^ (IJ J) is zero-error exactly achievable in the network block B if and only if (2,3) 
is zero-en'or exactly achievable in the extended network 
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Note that using properties listed above, we can never obtain R ^ where the number of non-zero entries in 
R' is strictly less than that in R, i.e. these properties still suggest that determining the capacity of a two-unicast 

network can be strictly easier than determining that of a fc-unicast network with k > 2. Our result, Theorem 

shows that this is not the case. For pedagogical value, we state and prove the theorem in its full generality, proposing 
a reduction from a {k + m)-unicast network to an (m -f l)-unicast network. 

Theorem 6. For k > 2,m > 1, let i?i, i? 2 , • ■ • > Rk, Rk+i, ■ • •, Rk+m, ri,r 2 ,..., rm > 0 he non-negative integers 

such that Ri — SJLi O'- Then, 

k 

, R 2 1 ■ ' • 1 Rk t Rk-\-l 1 Rk-\-2 1 ■ ■ ■ t Rk-\-m) ^ Ri •> Rk-\-l “t“ ; Rk-\-2 '^2i ■ ■ ■ i Rk-\-m “1“ ) (2^^) 

2=1 


Vector Linear codes 


General codes 


Zero-en‘or Exact 
Achievability 


Zero-eiTor Capacity 


Shannon Capacity 




TABLE II 

The notions of capacity for which Theorem[6]holds are shown by /’s. ?’s show the notions for which it is unclear if 

THE proposed REDUCTION WORKS. 


The main motivation for Theorem is the following implication; 


(i?l, i?2, • ■ • , Rk) ^ 


fk-l 




k2=l 


2=1 


(28) 


i.e. the general two-unicast problem is as hard as the general multiple-unicast problem. Using the monotonicity 
property of this suggests that the difficulty of determining achievability of a rate tuple for the fc-unicast problem 
is related more to the magnitude of the rates in the tuple rather than the size of fc. Moreover, we have 


(1,1,1,...,l)^(fc-l,fc), (29) 

k times 

i.e. solving the fc-unicast problem with unit-rate (which is known to be a hard problem for large fc 0) is no 
harder than solving the two-unicast problem with rates (fc — 1, fc). Furthermore, the construction in our paper along 
with the networks in 0.0. m can be used to show the following. 

Theorem 7. There exists a two-unicast network in which a non-linear code can achieve the rate pair (9,10) but 
no linear code can. 


Theorem 8. There exists a two-unicast network in which non-Shannon information inequalities can rule out 
achievability of the rate pair (5,6), but the tighest outer bound obtained using only Shannon-type information 
inequalities cannot. 

We leave the proofs of Theorems [7] to Appendix [C] [D) [E| respectively. We only note here that the key idea 
in the proof is a network reduction as shown in Fig. 
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We have only considered the notion of zero-error achievability in this section. We can show that the reduction 
proposed in the proof of Theorem works for the notions of capacity as shown in Table |n] (see Remark at end 
of Appendix [C). The reduction works successfully for the /’s. It is not known whether the reduction will work 
successfully for the notions of capacity given by ?’s. 
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Appendix 

A. Proof of the Two-Multicast Lemma (Lemma^ 

Proof The necessity of these conditions is obvious from the cutset bound B- For proving sufficiency, fix a rate 
pair that satisfies these conditions and consider a new network J\f obtained by adding a super-source s 

with two outgoing edges to si and S 2 with link capacities i?i and R 2 respectively as shown in Fig. Note that 
capacities of the newly added edges in Af depend on the chosen rate pair (i?i, i? 2 )- 



Fig. 7. Two-multicast network Af is obtained from a given two-unicast network and a specified rate pair (i?i, R 2 )- 


We use the single source multicast theorem 0’ 0 on J\f to infer the existence of a linear coding scheme for 
super-source s multicasting at rate Ri -\-R2 to the destinations ti and t2. This allows us to construct a two-multicast 
scheme in the original network Af achieving the desired rate pair. □ 

B. Proof of Theorem 

Proof Define Ci{S) := min{C'(T) :TCS, T is an Si — ti cut} for i = 1,2 as before. 

As S' is a minimal GNS-cut, the GNS outer bound for {G,C) is given by 

Ri < Ci{S),R 2 < C 2 {S),Ri+R 2 < C(S). (30) 


14 





We will assume that Ce is an integer for each e G S and describe scalar linear coding schemes over the binary 
field F 2 with block length N = 1 achieving the GNS outer bound. Having done this, it is easy to see that the 
theorem would also hold for choice of non-negative rational and thus, also non-negative real choice of Ce,e G S. 
Henceforth, we will imagine a link of capacity Ce as having Ce unit capacity edges connected in parallel. This 
change could be made in the graph and in this proof, we will use Q to denote the graph with all edges having unit 
capacity, possibly having multiple edges in parallel connecting two vertices. 

Note that a given GNS-cut S is minimal if and only if ^ \ e is not a GNS-cut for each e G S. This allows us to 
partition the edges in S by their connectivity in C/ \ {S' \ e} as S{ U Sj U SP U S{ U S| U SP U Sp U SJ2 U SP 
where e G S lies in S^ if, in the graph G\{S\ e}, tail(e) is reachable only from source indices x and head(e) is 
capable of reaching only destination indices y. Eg. Sp contains edge e in S if and only if in C/ \ (S \ e}, we have 
that tail(e) is reachable from si,S 2 and head(e) can reach t 2 , but cannot reach ti. 

Define Si := S{ U S{^ U Sp U SP and S 2 := S| U SP U Sp U Sp. Thus, Si, for i = 1, 2 is the set of edges 
in S which have their tails reachable from Si and their heads reaching ti by paths of infinite capacity. We will 
show Ci{S) = C{Si) + Cg\s -for * = 1,2. By the Max Flow Min Cut Theorem, there exists a flow of value 
Ci{S) from Si to ti in Q. At most C{Si) of the flow goes through edges in Si. Thus, there exists a flow of value 
at least CpS) — C{Si) in ^ \ Si. So, (si; fp > CpS) — C{Si). Now, consider Ti C S in Q such that Ti is 
an Si — ti cut and C{Ti) = Ci{S). Then, since Si C Ti, we have that Ti \ Si is an Si — U cut in Q\ Si. Thus, 
Cg\sM-,U) < C{T, \ Si) = C{Ti) - C(S0 = CpS) - C{S,). 

Case I; S is a minimal GNS-cut such that Q\S has no paths from either of si,S 2 to ti,t 2 . In this case, 
52, S'! = 0 by minimality of S. Thus, CpS") -f C'2(5') > C(Pi) -f €{ 82 ) = C(S) + C'(S'P) > C(S). So, in this 
case, the GNS outer bound ( [30l l is a pentagonal region and we have to show achievability of the two corner points 
(Ci( 5 ),C'(,S)-Ci( 5 )) and - C2(,S), C2(^)). 

Consider the following scheme. Edges in S}^, S'p, S'P forward si’s message bits to ti and edges in S 2 , S'p, S'P 
forward S 2 ’s message bits to t 2 . This achieves 

Ri = C(Si) = C(Sl) + C(S'P) -f C(S'P) -f C(S'P), 

R 2 = C{Sl) + C(S'p) -f C(S'P). 

Note that we have + i ?2 = C{S) for this rate pair. Now, we will increase Ri up to C'i(5') while preserving 
this sum rate. Construct unit capacity edge-disjoint paths from si to ti in Q\Si. This gives us 

Cg\gi {si;ti) paths in Q such that none of them use any edge in § 1 . Any such path encounters a first finite capacity 
edge from S'p and a last finite capacity edge from Sp. The intermediate finite capacity edges may be assumed to 
lie in S| only. If intermediate finite capacity edges lie in Sp or SP, we can modify the path so that this is not the 
case, while preserving the edge-disjointness property. Now, a simple XOR coding scheme as shown in Fig. [^a) 
improves Ri by one bit and reduces R 2 by one bit as S 2 has to set 61 0 &2 0 ^3 = 0 to allow ti to decode a. 
In the general case, we have an arbitrary number of finite capacity edges from S| along the path, for which we 
perform a similar XOR scheme. Because the paths are edge-disjoint, the finite capacity edges on those paths are 
all distinct, so the imposed constraints can all be met by reducing R 2 by one bit for each such path. When this 
is carried out for each of the paths, we have a scheme achieving (C'i(S'), C'(S') — C'i(S')). Similarly, 

{C{S) — ( 72 (S'), 02 (5)) may be shown to be achievable. 

Case II; S is a minimal GNS-cut such that Q\S has no paths from si to < 1 , S 2 to ^ 2 , or S 2 to ti but it has paths 
from Si to ^ 2 - As S is a minimal GNS-cut, we have Sf = 0. In this case, the GNS outer bound ( |30l ) is not necessarily 
a pentagonal region. We first show achievability of the rate pair Ri = ( 7 i(S),i ?2 = min{( 72 (S), (7(S) — (7i(S)}. 

Stage I - Basic Scheme; It is easy to see that we can achieve the rate pair given by 

Ri = G(Si) = CjS-J) 0 G(S'P) + C{Sr) + C(Sll), 

R 2 = C{Sl) 0 G(S'P) 0 C{Sl 2 ) 0 min{G(S'{), (7(S'P)}, 

by a routing + butterfly coding approach as follows. 

• Edges in S}, S'P, Sp forward si’s message bits to ti and edges in S|, SP, Sp forward S 2 ’s message bits to 
^ 2 - 

• Edges in SP and S\ along with an infinite capacity path from si to ^2 perform “preferential routing for si 
with butterfly coding for S 2 ,” i.e. 

- if ( 7 (Sp < ( 7 (SP), then an amount of ( 7 (SP) — ( 7 (Sp of the capacity of edges in SP is used for 
routing si’s message bits, while the rest is used for butterfly coding, i.e. an XOR operation is performed 
over ( 7 (Sp bits from source si with ( 7 (Sp bits from source S 2 to be transmitted over the edges in Sp. 
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Edges in S\ provide C{Sl^) bits of side-information from S 2 to fi, while the infinite capacity path from 
Si to f 2 provides side-information to t 2 - 

- if 0 ( 82 ) > 0 ( 812 ), *^hen all of the capacity of edges in is used for butterfly coding. 

Stage II - Improving Ei up to C'i(S'): We know Cg^g^(si;fi) = Ci(S') — C(Si). Find Cg^^g^(si;fi) unit 
capacity edge-disjoint paths from si to ti in Q such that none of them use any edge in Each such unit capacity 
path from si to ti in Q starts with a first finite capacity edge in S' 12 , ends with the last finite capacity edge in 
82 ^^ or 8 \ and with all intermediate edges lying, without loss of generality, in 82 - Whenever the capacity of all 
edges in 82 is used up, we would have reached a sum rate of 0 ( 8 ), as all edges are carrying independent linear 
combinations of message bits. In that case, we will increase i?i by one bit and reduce R 2 by one bit. Else, we will 
increase Ri by one bit while not altering i? 2 - 

• If the last finite capacity edge lies in 8 ^^, perform coding as in Fig. [^a). If the capacity of 82 edges is not 
fully used, use free unit capacity of some edge e G S '2 to relay the XOR value of 61 © 62 © 63 from S 2 to ti. 
Use the infinite capacity path from si to t 2 to send the symbol a. If there is no free edge in 82 , then S 2 sets 
61 © 62 © &3 = 0. This increases i?i by one bit and reduces R 2 by one bit. 



(a) Coding Performed in Case 1. Also used 
in Case II, Stage II - Last finite capacity edge 
in 512 


(b) Case II, Stage II - Last finite capacity 
edge in 5^ 


Fig. 8. Improving Ri up to Ci{S) 


• Suppose the last finite capacity edge, call it 63 , lies in 82 - Suppose there is a free edge e G S' 2 . If 63 is being 
used, it must be used as a conduit for side-information to U, as part of the butterfly coding. Use e to relay 
that side-information to ti. So, we can assume 63 is free. Now, perform coding as in Fig. [^b). Use the infinite 
capacity path from si to t 2 to relay the symbol a. This improves i?i by one bit while R 2 remains unchanged. 
If there is no free edge in then we must have achieved a sum rate of 0(8). Edge 63 now relays a to ti 
improving i?i by one bit. However, the edge 63 must have been assisting in butterfly coding using some edge 
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in S'll and the infinite capacity si — t 2 path. Now, the edge 63 can no longer provide side-information to ti. 
So, the corresponding unit capacity in some edge in now performs routing of si’s message bit as opposed 
to XOR mixing of one bit of si’s message and one bit of S 2 ’s message. This reduces R 2 by one bit. 

This can be carried out for the Cg^g^(si;ti) edge-disjoint paths sequentially. 

Stage III - Improving R 2 up to min{C'(5') — C'i(S'), C' 2 (iS')}: If the capacity of S 2 edges is all used up, we have 
achieved a sum rate of i?i -|-i ?2 = C{S) and so, R 2 = C{S) — Ci{S). If not, we have Ri = Ci{S),R 2 = C{S 2 )- 
We have C 2 {S) = 0 ( 82 ) -f ( 52 !^ 2 )- Similar to before, we find Cg\^g^{s 2 ]t 2 ) unit capacity edge-disjoint paths 
from S 2 to t 2 in Q such that the paths don’t use any edge in 82 - Each such unit capacity path encounters a first 
finite capacity edge from 8^2 or 82 and a last finite capacity edge from 8 }^ while all intermediate finite capacity 
edges may be assumed to lie in S'!. Note that edges in S'P, 8^2 are all performing pure routing of si’s message. 
At any point, if the capacity of S '2 edges is fully used, we have reached i?i = C'i(S'), R 2 = C{ 8 ) — C'i(S'). If the 
capacity is not fully used, perform the modification as described below. 

• If the first finite capacity edge lies in 8 ^ 2 , perform coding as in Fig. |^a). Use unit capacity of a free edge 
in 82 to relay symbol b from S 2 to ti and use the si to ^2 infinite capacity path to send the XOR value of 
oi 0 02 © 03 to t 2 ■ This leaves Ri unaffected and improves R 2 by one bit. 




(a) Case II, Stage III - First finite capacity (b) Case II, Stage III - First finite capacity 
edge in Sjj edge in S 2 

Fig. 9. Improving R 2 up to min{C(S) — Ci{S),C 2 (S)} 

• Suppose the first finite capacity edge, call it ei, lies in S' 2 . If ei is not being used, perform coding as in 
Fig. §b). Use unit capacity of edge ei G S '2 to send a symbol b from S 2 to ti. The infinite capacity si to 
t 2 path is used to send oi © 02 from si to ^ 2 - This allows ^2 to decode b and improves R 2 by one bit while 
leaving Ri unaffected. If Ci is being used for sending side-information to ti (as part of the butterfly coding or 
in Stage II), then pick some free edge e G 82 for the transfer of side-information freeing up ei and allowing us 
to use the coding described in Fig. |^b). If ei is being used but not for sending side-information, it must have 
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(a) Case II, Stage III - e', e", ei are being used in Stage (b) Case II, Stage III - Chosen S 2 -t 2 path uses edges 
II. 62,63 serve to route si’s bits to ti. 61 , 62 , 63 . Modified scheme uses some free edge e £ 

cl 

O2. 

Fig. 10. Improving R 2 up to min{C(S') — Ci(S), 02 (S)} in the case when 61 was already being used in Stage II. 


gotten used in Stage II as the last finite capacity edge on an si — ti path. In this case, we use some free edge 
e S 5*2 and superimpose scheme shown in Fig. [^b) with already existing scheme Fig. [^b). This modification 
is shown via Fig. [TO|a) and Fig. [TO|b). This improves R 2 by one bit while i?i remains unchanged. 

This stage terminates achieving Ri = Ci{S),R 2 = min{C'2(S'), C(S') — Ci(S')}. Because the GNS-cut is not 
symmetric in indices 1 and 2, we also have to show achievability of the rate pair i?i = minjCi (S'), C'(S') — 
C' 2 (S)},i ?2 = 02 ( 8 ). This can be shown similarly. 

Case III: S is a minimal GNS-cut such that Q \ S has no paths from si to ti, S 2 to ^ 2 , or si to t 2 but it has 
paths from S 2 to G. This case is identical to Case II. □ 

□ 


C. Proof of Thm. 

Proof Let us split the number X)i=i G tnto a ‘coarsest common partition’ formed by ci, C 2 ,..., c; as 

shown in Fig. 11 Set cq = 0. Recursively define ct as the minimum of 




s h — 1 

^ -Si' - ^ c-u 

■ i' — l u—1 


(31) 
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and 




t 

E’ 


h-l 

E- 

u—l 


(32) 


Note that by definition, Ch > 0 even if some of the Ri and/or rj were equal to 0. Dehne I by X]L=i 
I satisfies maxjfc, m} < I < k + m — 1. We will alternately denote Ch by C(i j) where i and j are the arg min’s in 
iU and ( |32| ) respectively. We will use X to denote the indices {i,j) that correspond to C(ij) = Ch for some h. In 
the rest of this proof, we will have i, fg denote an index belonging to {1, 2,, k}, j,jo denote an index belonging 
to {1, 2,..., m} and {i,j) or (io,io) denote an index belonging to X. Note that 


E/ ~ E/ 

E “ E '"(*■/) “ 


(33) 

(34) 



Fig. 11. Splitting of the number obtain (c^ : h = 1,2,..., 1) 


Given a (fc + m)-unicast network block B with source-destination pairs (s'^, t'fj, h = 1,2,... ,k + m, we extend 
it into an (m -I- l)-unicast network Af as follows: 

• Create sources s, si, S 2 , ■ ■ ■, Sm and their corresponding destinations ■ ■ ■ ,tm- Create nodes vi,V 2 , ■ ■ ■ ,Vm- 

Create nodes for each {i,j) G X. 

• For j = 1, 2,..., m, create edges of capacity Rk+j from Sj to Vj, vj to and to tj. (see Fig. [T2?a)) 

• For each (z, j) G I, create edges of capacity C(^ij) from s to a;(i j) to s', Sj to to 2(ij), as shown 

in Fig. [T^a). and the butterfly edges as shown in Fig. [T^b). 

We will prove that {Ri, i? 2 ,. ■., Rk+m) is achievable (or achievable by vector linear coding) in the {k -I- m)- 
unicast network B if and only if ..., is achievable (respectively achievable by vector 

linear coding) in the {m -G l)-unicast extended network Af. 

This will establish that any algorithm that can determine achievability of Rk+i, ■ ■ ■, Rk+m) may be 

applied to our extended network to determine achievability of (i?i, i? 2 , • ■ •, Rk+m) in the network block B. 

Suppose {Ri,R 2 , ..., Rk+m) is achievable in the (fc -f m)-unicast network block B. Then, we can come up 
with a ‘butterfly’ coding scheme which proves the achievability of the rate tuple Ri^Rk+i + '>’iiRk +2 + 

+ 2 , ■ ■ ■, Rk+m + I'm) in the {m -I- l)-unicast network N. This can be done simply by making ™tl 

performing butterfly coding over each butterfly network component. This means we set Wij = Zij + Yij,Yij = 
Xij + Wij and Xij = Wij + Yij. The addition here is done over an Abelian group Zi (summation modulo 
integer 1) where I is the size of the common finite alphabet that Xij,Yij,Wij take values in, with the alphabet 
mapped to the Abelian group according to some arbitrary bijection. 

Now suppose that the rate tuple Rk+i + fi, Rk +2 + ?' 2 ) • ■ ■) Rk+m + ?'m) is achievable in the network 

Af. We want to show that {Ri, i? 2 , • • •, Rk+m) is achievable in the {k + TO)-unicast network block B. We will hrst 
present a plausibility argument for this. 

By tightness of the incoming rate constraint at tj and looking at all symbols that enter block B, we will 
inevitably require Vj to have all the information about Vj. Similarly, we will require to have all the 
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M\ M2 Mjji 




Fig. 12. (a) shows the (m + l)-unicast network Af constructed around a given {k + m)-unicast network block B. The label in red is the edge 
capacity and the label in blue is the random variable that flows through that edge, (b) shows the butterfly network component in the extended 
{m + l)-unicast network Af for each {i,j) S X. Each edge in this component has capacity The label in red is the edge capacity and 

the label in blue is the random variable that flows through that edge. 


information about respectively which will further necessitate that butterfly coding be done over the 

butterfly component and this will be possible only if has all the information about 

Now, if the capacity of any outgoing edge of a vertex is at least as large as the sum of the capacities of all 
incoming edges at that vertex, we will assume, without loss of generality, that the vertex sends all of its received 
data on that outgoing edge. We first state and prove a straightforward lemma that will be useful. 


Lemma 2. Suppose A^B^C, D are random variables with B,C,D mutually independent and satisfying H{A\B, D) = 
0. Then, 

a) H{A\B,C) = Q H{A\B)=Q. 

b) H{B\A,C) = Q H{B\A)={). 


Proof H{B, C, D) + H{A\B, C, D) = H{B, D) +H{A\B, D) + H{C\A, B, D). Mutual independence of B, C, D 
gives H{B,C\D) = H(B,D) + H{C). Further, 0 < H{A\B,C,D) < H{A\B,D) = 0. So, we get H{C) = 
H{C\A,B,D), i.e. I{C] A, B, D) = 0. By the chain rule, this implies both I(C',A\B) = 0 and I{C;B\A) = 0, 
i.e. H{A\B) = H{A\B,C) and H{B\A) = H(B\A,C). This completes the proof. □ 


Define random variables as shown in Fig. i.e. let M denote the input message at source s and for each 


j = 1, 
j = 1: 


2 , 

2 ,... 


, TO, let M, 


,TO, 


3 

and X, 


denote the input message at source Sj. Furthermore, let the random variables F,, Vi, for 


(ij)’ ^{i, 3 ) G 2 : be as shown in Fig. 12 a) and Fig. I2'h). 


We will measure entropy with logarithms to the base |-4|^, where A is the alphabet and lyis the block length. 
M, Ml, M2, ..., Mm are mutually independent. H{M) = and for each j, H{Mj) = Rk+j + Vj. Let us 

write A-^ B \f H{A\B) = H{B\A) = 0. By observing the tight outgoing rate constraints and encoding at sources 
s,Si,S 2 , ■ ■ ■ ,Sk, and the tight incoming rate constraints and decodability at destinations t,ti,t 2 , ■ ■ ■ ,tk, we can 
easily conclude 
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M o (35) 

Vj : M, o U,{Y(,,,)} U {Vj} O U,{F(,,,)} U {Vj}, (36) 

V(^, j) : = C(,,,), (37) 

V(i,j): i7(F(,,,)) = i7(%,))=C(,,,), (38) 

Vj: H{Vj)=H{Vj) = Rk+j. (39) 


The random variables in the collection 

U(^,ri U U (U,{V^,}) (40) 

are mutually independent. In particular, ( [JT] !, ( [39| l ( |40l l imply that the messages received by the sources of the 
network block s'^ fork — 1, 2 ,..., A: + m, are mutually independent and the symbol received by has entropy 
Rh- 

Now, fix any {i,j) G 1. 


j ^j) ~ ^j) 

(£) 


(41) 

(42) 

(43) 

(44) 

(45) 


where (a) holds because Xyj) is a function of M and M is independent of Mj, (b) holds because Yy^j) is a 
function of {Xy jyWyj)), and (c) follows from ( [36l l, ( [38l l, ( |39l l. Combining the inequality chain (|4T]i-(|45ll with 
the edge capacity constraint H{Wy j)\Xyj'^) < H{Wyj'f) < cyjy we obtain 


(46) 

H{Wy^y\Xy^y) = Cy^^y (47) 

HiWy,y\Xyj),M,) = 0. (48) 


Similarly, 


H{Wy,y\Yy^y)-H{Wy^y\M,Yy^y) 
=I{Wy,,yM\Yy^y) 
=I{Yy^,yWy^,yM) - I{Yy^,yM) 

(e) 

{f} 


(49) 

(50) 

(51) 

(52) 

(53) 


where (d) holds because Yy y is a function of Mj and Mj is independent of M, (e) holds because Xyj') is a 
function of (Yy^y Vk(ij)), and (/) follows from (|3^, ([37|i. Combining the inequality chain (|49l)-(|53l) with the edge 
capacity constraint H{W(i j'f\Yyj'j) < H{Wyy) < cy jy we obtain 


From (|3^, we may rewrite (|48ll as 


From ( [T5 ] i, we may rewrite 


as 


HiWy,,)\Yy^jyM) = 0. 

HiWy,,)\Xy^,yV,Mo{yi^o,J)})=0■ 

l^(i j') ’Jo{^(io Jo)}) ~ (^• 


(54) 

(55) 

(56) 

(57) 
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Using Lemmata) with C = {V,}Uio{Y(,oj)}\{Y(ij)}, Z? = 

{X(i j)}, and using ( |40| l, ( |5^ , ( |57| l, we obtain 



(58) 

Now, by the chain rule for entropy, 



(59) 

Using (14|), (|g, (|^, @, @ in @, we get 



(60) 

From the encoding constraint at node we have 


^ = 0. 

(61) 

Putting (|60ll and (|M]l together, we get 


^(X(i,j)\Y(i,j)i = 0. 

(62) 

From the encoding constraint for network block B, we have that 


Yl^iZ{i,j)\ Ujo {Vjg} {2fioj(,}) = 0. 

(63) 

Using Lemma|^b) with A = Z(ij),B = X(i^j),C = = U^ol^iol U(*o,io) {^*o jol \ {X(t,j)} and using 

(|40li, (|62|i, (|63|l, we obtain 

= 0- 

(64) 

From (|40li, ([3^, we have that for any i = 1,2,..., fc, 7Z(Uj{2f(jj')}) = Ri and (|64|) implies j)}| Uj 

j)}) = 0. This shows that in the block B, the destination f' can decode source s'’s message for i = 1, 2,..., fc. 
Fix any j = 1, 2,..., m. From (|36]l, we have 

H{V,\M,)=0 

(65) 

By using ([36ll, we can rewrite (|65ll as 


H{Vj\VjMo{Yi^„,,)})=0. 

(66) 

By the encoding constraint provided by the network block B, we get 


^ (^'1 "^(*0 Jo);= 0- 

(67) 

Using Lemmaa) with A = Vj,B = Vj,C = D = {'Jio, 3 oX(io, 3 o)) U (Ujo 

(|40|i, (|66ll and ([o7|i, we obtain 

{Y 30 } \ and using 

H{V3\V3) = 0. 

(68) 

By the chain rule for entropy. 


H{V,\V,) + B(V,) = H{V,\V,) + H{V,). 

(69) 

Using ([39l) and (|68|) in (|69]l, we get 


H{V3\V3) = 0. 

(70) 

This implies that the destination can decode message for j = 1,2,... ,m 

The case of the rate tuples assumed to be achievable by a vector linear coding scheme is 
the proof. 

within block B. 
identical. This completes 

□ 

Remark 5. The proof above used the notion of zero-error exactly achievable rates. It can be shown to go through 
for the notion of zero-error asymptotically achievable linear coding rates and vanishing error linear coding rates as 


follows. 
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First, a very simple argument yields that if a linear code makes an error with positive probability, then the error 
probability is at least Let g be the global decoding function for the network, i.e. the function that maps all source 
messages to all decoded messages at the respective destinations (as in Dehnition[^. If the code used is linear, then 
5 is a linear map over some hnite field and so, is p — id where id is the identity mapping. Let the null space of 
this map be S' = {u : g{v) — v = 0}. If g{vo) ^ vq for some vq, then 

g{v)^v, \/v G Vo + S := {vq + vi : vi G S}. (71) 

As S and vq + S are disjoint, Pr(u € S) + Pr(u G vq + S) < 1. But Pr(u G S) = Pr(z; G vq + S). So, Pr(?; G S) < |. 

The probability of error is Pr(i; ^ S) > |. This means that the zero-error asymptotically achievable linear coding 
capacity is identical to the zero-error linear coding Shannon capacity for any multiple unicast network. 

To show that the reduction works for zero-error asymptotically achievable rates, note that if for any e > 0, the 
rate tuple {J2i=i ~ Rk+i + ~ Ej Rk +2 + ’’2 ~ Cj ■ • ■ j Rk+m + ?'m ~ e) is zero-error asymptotically achievable 

by linear codes, then every single equality and inequality stated in the proof continues to hold upto a correction 

term 5{e) where 5{e) —?► 0 as e —>■ 0. From linearity, we can find a suitable choice of subspaces at - 

so that each source s' is transmitting an independent message at rate Ri — 5'{e), where 5'(e) —?► 0 as e —>■ 0. 

This completes the justification of the summary in Table |I^ In particular, the reduction works in full generality 
for linear codes. There are technical difficulties with showing that the reduction goes through for zero-error 
asymptotically achievable rates or vanishing error achievable rates when general codes are used. It is not known 
whether the reduction will work in these cases. 

D. Proof of Theorem 

Proof. Consider the network in Fig. 3 of Q, for which linear codes were shown to be insufficient to achieve 
capacity. This network can be converted into a 10-unicast network using the construction in | |28) . By applying our 
construction, we hnd a two-unicast network in which the rate point (9,10) is achievable by non-linear codes but 
not by linear codes. □ 

E. Proof of Theorem 

Proof. Consider the 6-unicast Vamos network in Fig. 13 of 0. This network is shown in Q to be matroidal (as 
dehned by them in Definition V.l) and hence, the best bound that can be obtained using Shannon inequalities on 
the maximum uniform rate achievable is 1. However, a unit rate per unicast is shown to not be achievable for this 
network. By applying our construction treating the Vamos network as a block B, we get a two-unicast network 
with desired rate pair (5,6). This can be naturally viewed as an 11-unicast network ff with unit rate requirement 
for each unicast session. 

Consider the auxiliary 11-unicast network N' obtained by removing the block B from ff and fusing source- 
destination nodes of B, i.e. fusing s' with f' for i = 1, 2,..., 6. It is easy to verify that the butterfly coding scheme 
proposed in the proof of Theorem can provide a linear coding scheme that achieves unit rate for each of the 11 
source-destination pairs of N'. This linear coding scheme naturally makes N' a matroidal network (as elaborated 
in Theorem V.4 of Q). 

The restriction of the matroids corresponding to the network in block B and the network N' to the intersection 
of their ground sets yields the full rank matroid on six elements. This is obviously a modular matroid, as defined 
in Sec. IV-A of ||^. Using Lemma IV.7 from Q (which guarantees the existence of a proper amalgam of matroids 
as long as their restrictions to the intersection of the ground sets is modular), we obtain that the 11-unicast network 
N is matroidal too. 

Since the 11-unicast network N is matroidal. Shannon inequalities cannot rule out achievability of unit rate for 
each of the 11-unicast sessions or alternately, achievability of (5,6) for the two-unicast network. However, if (5,6) 
was achievable in the two-unicast network, then the construction would imply achievability of unit rate for each 
session of the 6-unicast Vamos network, which is proved to be impossible in 0. Hence, (5,6) is not achievable 
in the two-unicast network constructed from the Vamos network. □ 
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